What is claimed is: 

1 . An apparatus for extracting an object from an image, comprising: 
an image input unit for receiving a query image including an object and an 

object extraction target image from which the object included in the query image is to 
be extracted; 

an object position determination unit for determining a position of the object in 
the object extraction target image using pixel based color feature matching; 

an image segmentation unit for segmenting each of the query image and the 
object extraction target image into a plurality of regions using image features 
including color or texture; and 

an object region determination unit for performing matching between the 
segmented regions in the query image and the segmented regions in the determined 
position of the object in the object extraction target image using color or texture 
features and determining a final object region using similarity in spatial adjacency 
between matching regions obtained as a result of the matching. 

2. The apparatus of claim 1 , wherein the object position determination 
unit comprises: 

a color histogram calculator for calculating color histograms with respect to 
the query image and the object extraction target image; 

an image projector for replacing the pixel values with respect to the query 
image and the object extraction target image with ratio histograms; and 

a candidate object position determiner for determining candidate object 
positions in the object extraction target image having the ratio histogram. 

3. The apparatus of claim 2, wherein the color histogram calculator 
calculates the number of pixels in a quantized color space with respect to each of the 
query image and the object extraction target image. 
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4. The apparatus of claim 2, wherein the candidate object position 
determiner performs convolution on the value of a mask determined based on a 
minimum botihding box surrounding the object included in the query image and the 
object extraction target image having the ratio histogram, calculates color distance 
differences between pixels with respect to which the resulting values of the 
convolution is no less than a predetermined threshold in the object extraction target 
image, and determines pixels as candidate object positions according to the average 
of color distance differences obtained with respect to each of the pixels in increasing 
order of the average. 

5. The apparatus of claim 1 , wherein the image segmentation unit 
segments the query image and the object extraction target image into regions using 
the image features including color or texture. 

6. The apparatus of claim 1 , wherein the object region determination unit 
comprises: 

a region matching unit for performing region matching with respect to the 
segmented regions of the query image and segmented regions corresponding to the 
object position in the object extraction target image using image features including at 
least color and texture and determining whether the object extraction target image 
includes an object according to the result of region matching; 

an adjacency matrix calculator for calculating a spatial adjacency matrix with 
respect to the segmented query image and calculating a spatial adjacency matrix 
with respect to an image resulting from the region matching on the segmented object 
extraction target image which is determined as having the object; 

a correspondence region detector for detecting correspondence regions 
between the query image and the object extraction target image using the adjacency 
matrixes calculated by the adjacency matrix calculator; and 
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a similarity calculator for calculating the similarity between the query image 
and the object extraction target image based on the correspondence regions and 
determining a final object region. 

7. The apparatus of claim 6, wherein the region matching unit detects a 
segmented region, which includes a pixel at the determined position of the object 
and meets a mask determined based on a region surrounding the object in the query 
image, in the segmented object extraction target image, calculates a similarity 
distance between each detected region and each of the segmented regions of the 
query image, and determined whether the object extraction target image includes the 
object. 

8. The apparatus of claim 6, wherein the adjacency matrix calculator 
assigns label numbers to the segmented regions of the query image and to 
segmented regions including the object of the query image in the object extraction 
target image and forms adjacency matrixes in which each element has a first value 
when corresponding regions are adjacent and has a second value when they are not 
adjacent, the adjacency matrixes showing information about how adjacent the 
segmented regions assigned the label numbers are in the query image and the 
object extraction target image, respectively. 

9. The apparatus of claim 6, wherein the correspondence region detector 
forms a comparison matrix using the adjacency matrixes in different manners 
according to whether the number of the segmented regions in the query image is 
greater or less than the number of segmented region in the object extraction target 
image to show the correspondence regions between the query image and the object 
extraction target image. 

1 0. The apparatus of claim 6, wherein the correspondence region detector 
forms a comparison matrix using the adjacency matrixes and using only segmented 
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regions, which have most similar image features to the segmented regions having 
label numbers in the query image, in the object extraction target image to show the 
correspondence regions between the query image and the object extraction target 
image. 

1 1 . The apparatus of claim 1 0, wherein the correspondence region 
detector determines the segmented regions having the most similar image features 
to the segmented regions of the query image in the object extraction target image 
using a distance matrix and reconstructs the comparison matrix according to the 
correspondence regions between the query image and the object extraction target 
image. 

12. The apparatus of claim 1 1 , wherein the distance matrix has the label 
numbers of the query image as row values and has the label numbers of the object 
extraction target image as column values, and each element in the distance matrix is 
a distance between a region assigned one of the label numbers in the query image 
and a region assigned one of the label numbers in the object extraction target image. 

13. The apparatus of claim 8, wherein the similarity calculator calculates 
the similarity by dividing the number of elements having the first value in an upper 
triangular matrix by the number of all elements in the upper triangular matrix in the 
comparison matrix. 

14. A method of extracting an object from an image, comprising the steps 

of: 

(a) receiving a query image including an object and an object extraction target 
image from which the object included in the query image is to be extracted; 

(b) determining a position of the object in the object extraction target image 
using pixel based color feature matching; 
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(c) segmenting the query image and the object extraction target image into a 
plurality of regions using image features including color or texture; and 

(d) performing matching between the segmented regions in the query image 
and the segmented regions in the determined position of the object in the object 
extraction target image using color or texture features and determining a final object 
region using similarity in spatial adjacency between matching regions obtained as a 
result of the matching. 

15. The method of claim 14, wherein the step (b) comprises the steps of: 
(b1) calculating color histograms with respect to the query image and the 

object extraction target image; 

(b2) replacing the color histograms with respect to the query image and the 
object extraction target image with ratio histograms; and 

(b3) determining candidate object positions in the object extraction target 
image having the ratio histogram. 

16. The method of claim 15, wherein the step (b1) comprises calculating 
the number of pixels at each bin in a quantized color space with respect to each of 
the query image and the object extraction target image. 

17. The method of claim 16, wherein the step (b2) comprises calculating 
the ratio histogram by dividing the number of pixels in each bin with respect to the 
query image by the number of pixels in all bins with respect to the query image. 

18. The method of claim 16, wherein the step (b2) comprises defining the 
ratio histogram as a ratio of the number of pixels in each bin with respect to the 
query image to the number of pixels in each bin with respect to the object extraction 
target image. 

19. The method of claim 15, wherein the step (b3) comprises the steps of: 
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(b3-1 ) performing convolution on the value of a mask determined based on a 
minimum bounding box surrounding the object included in the query image and the 
object extraction target image having the ratio histogram, 

(b3-2) calculating color distance differences between pixels with respect to 
which the resulting values of the convolution is no less than a predetermined 
threshold in the object extraction target image; and 

(b3-3) determining pixels as candidate object positions according to the 
average of color distance differences obtained with respect to each of the pixels in 
increasing order of the average. 

20. The method of claim 19, wherein the mask at a pixel (x p , y p ) is a circle 
defined by 
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0, otherwise 



bs 

WR = a(bs + (bl-bs)—) 
bl 

bl indicates the length of the longer side of the bounding box, bs indicates the length 
of the shorter side of the bounding box, and a indicates a variable for adjusting the 
size of the mask. 



21 . The method of claim 1 9, wherein the average color distance difference 
is defined by 

N indicates the number of valid pixels within the bounding box, q indicates the query 
image, and d indicates the object extraction target image. 

22. The method of claim 14, wherein the step (d) comprises the steps of: 
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(d1) performing region matching with respect to the segmented regions of the 
query image and segmented regions corresponding to the object position in the 
object extraction target image using image features including color or texture and 
determining whether the object extraction target image includes an object according 
to the result of region matching; 

(d2) calculating a spatial adjacency matrix with respect to the segmented 
query image and calculating a spatial adjacency matrix with respect to an image 
resulting from the region matching on the segmented object extraction target image 
which is determined as having the object; 

(d3) detecting correspondence regions between the query image and the 
object extraction target image using the adjacency matrixes calculated in step (d2); 
and 

(d4) calculating the similarity between the query image and the object 
extraction target image based on the correspondence regions and determining a 
final object region. 

23. The method of claim 22, wherein the step (d1) comprises the steps of: 
(d1-1) detecting a segmented region, which includes a pixel at the determined 

position of the object and meets a mask determined based on a region surrounding 
the object in the query image, in the segmented object extraction target image; and 

(d1-2) calculating a distance difference in color or texture between each 
detected region and each of the segmented regions of the query image to determine 
whether the object extraction target image includes the object. 

24. The method of claim 23, wherein the distance difference in color or 
texture is defined as a distance between two regions in a space of an image feature 
including color or texture, the distance between two regions is calculated from 

D CT ( X ,y) = wMx > y)+wA(x ' y) , 
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D c {x,y) and D t {x,y) indicate a distance between two regions x and y in a color 
space and a distance between the two regions x and y in a texture space, 
respectively, and w c and w t indicate weight coefficients, respectively, applied to the 
respective distances, 

25. The method of claim 22, wherein the step (d2) comprises assigning 
label numbers to the segmented regions of the query image and to segmented 
regions including the object of the query image in the object extraction target image 
and forming adjacency matrixes in which each element has a first value when 
corresponding regions are adjacent and has a second value when they are not 
adjacent, the adjacency matrixes showing information about how adjacent the 
segmented regions assigned the label numbers are in the query image and the 
object extraction target image, respectively. 

26. The method of claim 22, wherein the step (d3) comprises forming a 
comparison matrix using the adjacency matrixes in different manners according to 
whether the number of the segmented regions in the query image is greater or less 
than the number of segmented region in the object extraction target image to show 
the correspondence regions between the query image and the object extraction 
target image. 

27. The method of claim 22, wherein the step (d3) comprises forming a 
comparison matrix using the adjacency matrixes and using only segmented regions, 
which have most similar image features to the segmented regions having label 
numbers in the query image, in the object extraction target image to show the 
correspondence regions between the query image and the object extraction target 
image. 

28. The method of claim 22, wherein the step (d3) comprises determining 
the segmented regions having the most similar image features to the segmented 
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regions of the query image in the object extraction target image using a distance 
matrix and reconstructing the comparison matrix according to the correspondence 
regions between the query image and the object extraction target image. 



29. The method of claim 28, wherein the distance matrix has the label 
numbers of the query image as row values and has the label numbers of the object 
extraction target image as column values, and each element in the distance matrix is 
a distance between a region assigned one of the label numbers in the query image 
and a region assigned one of the label numbers in the object extraction target image. 

30. The method of claim 22, wherein when each element in the adjacency 
matrixes has a first value when corresponding regions are adjacent and has a 
second value when they are not adjacent, the step (d4) comprises calculating the 
similarity by dividing the number of elements having the first value in an upper 
triangular matrix by the number of all elements in the upper triangular matrix in the 
comparison matrix. 

31 . The method of claim 26 or 27, wherein in the step (d4), the similarity is 
calculated from 




and when each element in the adjacency matrixes has a first value when 
corresponding regions are adjacent and has a second value when they are not 
adjacent, E u indicates the number of elements having the first value in an upper 
triangular matrix of the comparison matrix, and M u indicates the number of all 
elements in the upper triangular matrix. 

32. A computer readable recording medium on which a program for 
executing the method of any one of claims 14 through 31 in a computer is recorded. 
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